Abstract of " Multilabel Classification over Category Taxonomies " Multilabel Classification over Category Taxonomies Finally I Want to Specially Thank My Father

of “Multilabel Classification over Category Taxonomies” by Lijuan Cai, Ph.D., Brown University, May 2008. Multilabel classification is the task of assigning a pattern to one or more classes or categories from a pre-defined set of classes. It is a crucial tool in knowledge and content management. Standard machine learning techniques such as Support Vector Machines (SVMs) and Perceptron have been successfully applied to this task. However, many real-world classification problems involve large numbers of overlapping categories that are arranged in a hierarchy or taxonomy. This poses a challenge to learning algorithms as they ignore the class hierarchies thereby losing valuable information. In this thesis, we propose to systematically incorporate prior knowledge on category taxonomy directly into the learning architecture. We present two methods, hierarchical SVM learning and hierarchical Perceptron learning. Both methods take a ranking view of the multilabel problem by focusing on ranking category relevances. In the hierarchical SVM, the hierarchical learning problem is expressed as a joint large margin formulation that simultaneously learns the discriminant functions of each class. As the resulting optimization problem can be prohibitively large, we also present a variable selection algorithm to efficiently solve it. In the hierarchical Perceptron method, the construction of weight vectors and the update rule are made to capture the category taxonomy. Both methods can leverage kernel techniques, work with arbitrary directed acyclic graph taxonomy, and be applied to general settings where categories can be characterized by attributes. We also present an automatic approach to learn a taxonomy if one isn’t available. Our approach is adapted from the hierarchical agglomerative clustering algorithm. The learned hierarchy can then be used in existing hierarchical classification approaches. Extensive experiments demonstrate the performance advantage of our approaches. Multilabel Classification over Category Taxonomies by Lijuan Cai B. Eng., Computer Science and Engineering, Nanjing University of Aeronautics and Astronautics, 1997 M. Eng., Computer Science, Nanjing University, 2000 M. Sc., Computer Science, Brown University, 2003 A dissertation submitted in partial fulfillment of the requirements for the Degree of Doctor of Philosophy in the Department of Computer Science at Brown University Providence, Rhode Island May 2008 c © Copyright 2008 by Lijuan Cai This dissertation by Lijuan Cai is accepted in its present form by the Department of Computer Science as satisfying the dissertation requirement for the degree of Doctor of Philosophy. Date Thomas Hofmann, Director Recommended to the Graduate Council Date Chad Jenkins, Reader Date Gregory Shakhnarovich, Reader Approved by the Graduate Council Date Sheila Bonde Dean of the Graduate School